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ABSTRACT 

We study six groups and clusters of galaxies suggested in the literature to be 'fos- 
sil' systems (i.e. to have luminous diffuse X-ray emission and a magnitude gap 
of at least 2 mag-R between the first and the second ranked member within half 
of the virial radius), each having good quality X-ray data and SDSS spectro- 
scopic or photometric coverage out to the virial radius. The poor cluster AWM4 
is clearly established as a fossil system, and we confirm the fossil nature of 
four other systems (RX J1331. 5+1108, RX J1340.6+4018, RX J1256.0+2556 and 
RX J1416.4+2315), while the cluster RXJ1552. 2+2013 is disqualified as fossil system. 
For all systems we present the luminosity functions within 0.5 and 1 virial radius that 
are consistent, within the uncertainties, with the universal luminosity function of clus- 
ters. For the five bona fide fossil systems, having a mass range 2 x 10 13 — 3x 10 M Q , we 
compute accurate cumulative substructure distribution functions (CSDFs) and com- 
pare them with the CSDFs of observed and simulated groups/clusters available in the 
literature. We demonstrate that the CSDFs of fossil systems are consistent with those 
of normal observed clusters and do not lack any substructure with respect to simulated 
galaxy systems in the cosmological ACDM framework. In particular, this holds for the 
archetype fossil group RX J1340. 6+4018 as well, contrary to earlier claims. 

Key words: galaxies: clusters: general; galaxies: luminosity function, mass function; 
galaxies: evolution; galaxies: formation; cosmology: observations 



1 INTRODUCTION 

Early numerical simulations suggested that the most com- 
pact galaxy groups could merge to form a single e lliptical 
galax y (hence a 'fossil group') in a few billion years (|Barnesl 
1 19891 ). An elliptical galaxy formed by the merger of such 
a group retains its X-ray emitting halo of hot gas, which 
is unaffected by merg ing (IPonman fc Bertram! [l993h Fol- 
lowing this indication, IPonman et al.1 (|l994h ~ discovered the 
arc hetype fossil group RX J1340 6+4018. 

IVikhlinin etail \ 19991 ) and Ijones et al.1 (|2003l h on the 
basis of ROSAT observations, have suggested that fos- 
sil groups constitute a considerable population of objects. 
Their X-ray extent, bolometric X-ray luminosity (Lx.bol > 
10 42 /i^ 2 erg s -1 ), dark matter dominated total mass, and 
mass in the diffuse hot gas component are comparable to 
those of bright groups and poor clusters of galaxies (~ 10 13 - 
10 14 h^Q Mq). The brightest member of a fossil group has 
an optical luminosity comparable to that of a cluster cD 
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galaxy (i.e., Mr < —22.5 + 51og /150) and dominates the 
galaxy luminosity function of the system. The observational 
definition of a fossil system lies in the detection of extended, 
very luminous X-ray emission from the hot gas of the intr- 
acluster medium (ICM), and in the existence of an R-band 
magnitude gap Ami2 > 2 between the brightest and second 
brightest members within 0.5i? v ir l|Jones et alj|2000h . 

As noted by IVikhlinin et al.1 (|l999h , fossil groups may 
represent the ultimate examples of hydrostatic equilibrium 
in virialised systems, since they must have been undisturbed 
for a very long time if they are the result of galaxy merging 
within a group. High-resolution hydrodynamical cosmolog- 
ical simulations in the ACDM framework have shown that 
fossil groups have already assembled half of their final DM 
mass at redshifts z ~^ 1, and subsequently they typically 
grow by minor mergers only, whereas no n-fossil systems 
of sim ilar masses on average form later (D'Onghi a et al.l 
120051 ). The early assembly of fossil groups leaves sufficient 
time for objects with luminosities close to the character- 
istic luminosity (i.e., L ~ L*) to merge into the cen- 
tral galaxy by dynamical friction, producing the magnitude 
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gap which defines a fossil system. In addition, the simu- 
lated fossil groups were found to be over-luminous in X- 
rays relative to non-fossil groups of the same optical lu- 
minosity, in qualitat i ve agreement with observations (cf. 



IVikhlinin et al. 19991; Jones et al 



.2000h . 

per, Ivon Benda-Beckmann et al] ([20081 ) showed that many 
galaxy groups may undergo a fossil phase in their lives but 
may not necessarily stay fossil down to z — 0, owing to 
renewed infall of L ~ L* galaxies from the large-scale en- 
vironment. Such infall episodes are statistically more likely 
for more massive systems, so that the fraction of quasi-fossil 
systems (i.e. those with a large luminosity gap between the 
central galaxy and the most luminous satellite) is lower 
among clusters than among groups (|Milosavlievic et al.l 
l2006r , lYang. Mo. fc van den Boschll200Sl ) . 

Fossil group s have become a puzzl ing problem to 
cosmology since ID'Onghia fc Lake! (|2004 DL04) showed 
that, with respect to state-of-the-art predictions on the 
frequen cy of substructures i n cold dark matter (CDM) 
halos l|De Lucia et alj [2004), a virialised system like 
RX J1340. 6+4018 lacks galaxies nearly as luminous as the 
Milky Way. Conversely, the same numerical simulations are 
able to accurately describe the frequency of substructures in 
galaxy clusters as massive as Virgo or Coma to well below 
the circular velocity of a Milky Way-size dark halo (i.e., with 
Vdrc ^ 220 km s" 1 ). In this respect, fossil groups appeared 
to exa cerbate the so-calle d 'small-scale crisis' of CDM uni- 
verses (|Klypin et al.lfl999l ). In fact, DL04 concluded that the 
missing substructure problem affects systems up to the scale 
of groups (typically with kTx ^ 1 keV). Ho wever, this re- 
sult has been challenged bv lSales et alj (2007), who find that 
the abundance and luminosity function of simulated fossil 
systems are in reasonable agreement with the few available 
observational constraints. 

Given the great interest of this cosmological issue, some 
optical studies have aimed at better characterizing the mass 
and lumin osity function (LF) of already known fossil sys- 
tems (e.g. iMendes de Qliveira et aD 20061; Cypriano et al.l 
2006) or identifying new ones (e.g. ISantos et al.ll2007h , al- 
though identifying low-mass fossil systems is hampered by 
the fact that groups are under-represented in existing X-ray 
catalogs. In spite of the increasing quality of the data and 
number of candidates, no new cumulative substructure dis- 
tribution function (CSDFfl has so far been produced for a 
fossil system to compare with that obtained by DL04 for the 
archetype fossil group RX J1340. 6+4018. The determination 
of the CSDF for fossil systems with a range of masses is the 
objective of the present study. 

In the following, we adopt a ACDM cosmological model 
(Q m = 0.3, Q.A = 0.7) with H = 70 km s" 1 Mpc" 1 . 
This model is consis tent with the main WMAP5 results (cf. 
Illinshaw et al.ll2008l). This work is m ainly based on Sloan 
Digital Sky Survey ( York et alj|200(l SPSS) data fr om the 
sixth data release ( Adelman- McCarthy et al] l2008t DR6, 
and references therein). 



2 THE FOSSIL SAMPLE 

In this study we consider five groups and poor clusters of 
galaxies from the samp l e of fo ssil s ystems origi n ally i den- 
tified by iPonman et all (|l994l ') and I Jones et all <|2003h . In 
addition we include the poor cluster AWM4 , whose sta- 
tus a s fossil system has been suggested by ILin fc Mohrl 
(|2004h and is established in this work (see Appendix IA1|) . 
These six systems were selected to have (i) high-quality 
X-ray observations, eith er with Chandra (IWeisskopf et all 
l2000f ) or XMM-Newton (|jansen et alll200ll ). to allow for a 
reliable determination of their halo properties (i.e., -R200, 
M200, VparcntjE and (ii) to be covered by SDSS photom- 
etry and, in the case of AWM4, by SDSS spectroscopy. 
This enables us to study membership (via spectroscopic 
redshifts or combining photometric redshifts and statistical 
foreground/background subtraction) and photometric prop- 
erties of members across a wide field, out to the virial ra- 
dius of a system. Such coverage is mandatory to enable us to 
compare the observed CSDFs with previous determinations 
and the output of cosmological simulations in the literature, 
which are normally computed out to the virial radius of a 
system (i.e., i?200iJ. Table [T] lists coordinates and redshifts 
of the six systems. 



2.1 X-ray data 

The X-ray and derived halo properties are reported in Ta- 
ble [2] along with the references to the works from which 
these data are taken. For all systems (except AWM4 and 
RXJ1416. 4+2315) M200 and -R20 are computed from the 
X-ray temperatures published by IKhosroshahi et all (l2007t ) 
using the scaling relations given by lArnaud et all {2005). 
We adopt their fits to the M200 — Tx and -R200 



T x rela- 
tions of the entire sample to derive our fiducial estimates. 
In our analysis in Sect. [3] we consider the effect of estimat- 
ing mass and radius from fits to both the entire sample of 
lArnaud et all (|2005T ). which has a slope of 1.71, and from 
fits to the hot systems alone (kT > 3.5 keV), which has 
a slope of 1.49. The resulting masses are reported in Ta- 
ble [2] Our motivation f or this cho i ce of relation is based 
on the recent results of ISun et all (|2008l ) . who derive the 
mass temperature scaling relation from 1 to 10 keV using 
high quality Chandra data of a large sample of groups and 
cluster s. Their M — T rela tion normalisation is similar to 
that of lArnaud et all |2005h . and they find a slope of 1.67, 
such that group masses would be 18 per cent higher at 1 
keV than that deri ved from the fit to the full sample of 
lArnaud et ai1(l2005T ). In using both Arnaud et al relations we 
wish to attempt to bracket the most likely value of the M—T 
normalisation in this m ass range. We note however that 
IKhosroshahi et all l|2007h suggest tha t fossil groups ma y fall 
low on the M — T relation, although ISun et all (120081 ) find 
no evidence for this with a smaller sample of fossil groups. 
The extent of the offset found by Khosroshahi et al. appears 



The cumulative substructure distribution function gives the 
number of sub-halos with circular velocity V c i rc larger than a 
given fraction of the circular velocity of the parent halo Vparent ■ 



2 ^200 is the radius within which the average density of the sys- 
tem is 200 times the critical density of the Universe. M200 is the 
mass within i?200- 

3 Throughout the paper we use -R200 as a proxy for the virial 
radius R vlr . 
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to be mass dependent and is negligible at higher group tem- 
peratures (kT > 2 keV) , although it could be up to a factor 
of 2-3 for the very lowest temperature systems. Deeper X- 
ray observations of fossil groups have been obtained to help 
resolve this issue, and will be the subject of a forthcoming 
paper. 

As we show in Sect. |3j the CSDFs we derive are relatively 
insensitive to the exact choice of X-ray scaling relation and 
our conclusions are robust in case fossil groups should indeed 
fall low on the M — T relation. 

For AWM4 and RX J1 416.4+2315, estim a tes of M 20 o 
and Jfeoo are tak e n fro m iGastaldello et all (|2007l ) and 
iKhosroshahi et al.l il2006j). r espectively, who fitted NFW 
profiles (|Navarro et al.l 19971 ) to the observed mass density 
profiles of these two systems. It is worth noting that there 
is a very good agreement between the estimates given in 
the two papers ref erred above and tho se derived from the 
scaling relations of lArnaud et alj (|2005t ). From Table [2] one 
can clearly see that our sample spans a broad range in mass 
and X-ray temperature, in the regime of groups and poor 
clusters. 

Once M200 and -R200 are obtained, the circular velocity 
of the parent halo of each system is computed : 



2.2 Optical data 

With the exception of AWM4, the nearest cluster at z = 
0.0317, the analysis of all systems relies on SDSS pho- 
tometric data only (including photometric redshifts). Al- 
though for some of them spectroscopic redshifts are avail- 
able through the SDSS or other published catalogs, the 
lack of completeness or insufficient depth prevents us from 
using them. The SDSS spectroscopic data, in particular , 
are limited to 17.77 mag (r band, see IStrauss et all [2002); 
this translates into absolute magnitude limits ranging from 
-20 (for RXJ1331. 5+1108 at z = 0.081) to -22.5 (for 
RXJ1256.0+2556 at z = 0.23), thus making the faint end 
of the luminosity function inaccessible to our analysis. In 
contrast, assuming a conservative limit of 20.5 r-mag, the 
SDSS photometry allows us to probe down to roughly one 
magnitude fainter than L* for all systems. Although one 
could in principle combine the complete information derived 
from photometric data alone with the spectroscopic mem- 
berships for the brightest galaxies or in the regions covered 
by other surveys, combining different selection functions is 
an unnecessary complication. In particular, we have checked 
that for all bright galaxies (r < 17.77 mag) with available 
spectroscopy the spectroscopic membership coincides with 
the purely photometric one. 

In Appendix |X] we comment further on issues specific 
to individual systems and on their status of fossil. In sum- 
mary, AWM4 is established as fossil; RXJ1331. 5+1108, 
RXJ1340.6+4018 and RX J1416. 4+2315 are confirmed fos- 
sil systems; observational uncertainties do not allow us to 
establish RX J1256. 0+2556 as a fossil with very high con- 
fidence, but we will consider it as a fossil in the following; 
lastly, RX J1552. 2+2013 does not match the magnitude gap 
requirement and is disqualified as a fossil system. 



Table 1. The sample 



Denomination 


RA 


Dec 


z 




(J2000.0) 


(J2000.0) 




AWM4 


16:04:57.0 


+23:55:14 


0.0317 


RXJ1256.0+2556 


12:56:03.4 


+25:56:48 


0.2320 


RXJ1331. 5+1108 


13:31:30.2 


+11:08:04 


0.0810 


RXJ1340.6+4018 


13:40:33.4 


+40:17:48 


0.1710 


RXJ1416.4+2315 


14:16:26.9 


+23:15:32 


0.1370 


RXJ1552.2+2013 


15:52:12.5 


+20:13:32 


0.1350 



3 THE CUMULATIVE SUBSTRUCTURE 
DISTRIBUTION FUNCTION: METHOD 

In this section we describe how the cumulative substruc- 
ture distribution function is computed for the systems in 
our sample. As mentioned in Sect. [T] the CSDF of a galaxy 
system, N(> x = Khc/Vparcnt), is defined as the number of 
members (i.e., substructures of the parent DM halo), other 
than the brightest member, which are satellites and have cir- 
cular velocities V c i IC larger than xV pa , TB nt- Here V pa rcnt is the 
circular velocity of the parent system considered as a whole 
(defined in Eq. [TJ and x < 1. Theoretically, each galaxy in 
a group/cluster is associated with a DM sub-halo of a given 
mass M su b and radius J? su b such that the circular velocity 
is simply defined as V c ii C = y GA4 BU ^ / R BU b ■ Observationally 
this information is only accessible for few well studied galax- 
ies. For the galaxies in our systems circular velocities must 
be derived from basic observables (luminosity, central veloc- 
ity dispersion) by means of scaling relations, as we describe 
in Sect. I3TT1 

The second essential ingredient for computing the 
CSDF is the method to count galaxies up to a given cir- 
cular velocity, either by means of a complete cluster mem- 
bership selection based on spectroscopic redshifts, or by 
means of a robust statistical subtraction of the galaxy fore- 
ground/background from the counts in the cluster/group 
region. This is discussed in Sect. 13.21 

3.1 Inferring V c i IC 

The structure and luminosity of galaxies are known to 
be linked to their kinematics via scaling relations. For 
late-type (spira l ) gal axies the TuUy-Fisher (TF) relation 
l|Tulry fc Fisherl Il977l ) links luminosity and (maximum or 
asymptotic) circular velocity in the disk, which we assume 
to coincide with V^i r J3- For early-type (elliptical) galaxies 
the central velocity dispersion ao can be inferred either 
from the luminosity usi ng the Faber- Jackson (FJ) relation 
ijFaber fc Jackson! Il976l ) or, when more information about 
the surface brightness distribution is available, via the fun- 
damental plane (FP) relation that connects half light ra- 
dius, effective surface brightness, and central velocity dis- 
persion (Jo. Once o"o is known, the circular velocity can then 
be inferred. In doing so, one can either assume isothermal 
dynamics, in which case Kh-c ~ \/2o"o, or adopt empirical 
scaling relations between the two quantities based on very 

4 This is an approximation that may lead to a systematic over- 
estimate of t he true V c j IC at the sub-halo virial radius by some 10 
per cent (see lSalucci et al]|2007l) . 
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Table 2. X-ray and halo properties of the sample systems 



Denomination 


[keV] 


T a 

[10 42 org s" 7 ] 


*f 2 no 
[10 13 M 




R200 
[Mpc] 




^200 
[arcmin] 




Vp„ ont 
[km s" 1 




Rof£ 










'hot' 




'hot' 




'hot' 




'hot' 




AWM4 


2.48 ± 0.06 


39.3^ 


13.75 ± 1.46 




1.054 ± 0.038 




29.10 ± 1.05 




783 ± 10 




G07 


RXJ1256. 0+2556 


2.63 ± 1.13 


50.0 


15 75+ 13 - 38 


19.63 


1.034+g;^ 


1.107 




4.99 


809 ± 200 


873 


K07 


RXJ1331. 5+1108 


0.81 ± 0.04 


2.1 


2.25 ± 0.19 


3.67 


0.571 ± 0.016 


0.664 


6.23 ± 0.17 


7.25 


411 ± 12 


487 


K07 


RXJ1340. 6+4018 


1.16 ± 0.08 


5.2 




5.99 


0.670 ± 0.026 


0.759 


3.83 ± 0.14 


4.35 


506 ± 20 


582 


K07 


RX J1416. 4+2315 


4.00 ± 0.62 


170.0 


31.00 ± 10 




1.220 ± 0.060 




8.39 ± 0.41 




1045 ± 90 




K06 


RXJ1552. 2+2013 


2.85 ± 0.90 


60.0 


19 03+ 11 ' 48 


23.28 


1 139+ 0193 
i.±oa_ 222 


1.213 




8.45 


849 ± 150 


909 


K07 



a Bolometric, within i?200> unless specified otherwise. 

6 G07= lGastaldello et al.l 11200711 , K07= lKhosroshahi et all (1200711 , K06= lKhosroshahi et all hOOdt) 
c Within 455 kpc, (0.1-100 keV) 



deep observa tions of extended rotation curves in early-type 
galaxies (e.g. lPizzella et al.ll2005l ; lFerrarese| [2002). In the fol- 
lowing analysis we adopt the relation given by Pizzella et al.l 
l|2005l ). viz., 



Vrirc = (1.32 ± 0.09)a + (46 ± 14) [km s _1 ] 



(2) 



as it includes a comprehensive sample of both low and high 
surface brightness galaxies over the range between ~ 50 and 
350 km s~ , and is therefore best suited for an heteroge- 
neous sample like ours. In fact Equation [2] applies to every 
galaxy, irrespective of its morphological type, provided that 
the central velocity dispersion is measured. 

We note that the analysis presented in this work relies 
on the reasonable assumption that scaling relations hold ev- 
erywhere and phenomena like the tidal truncation of sub- 
halos do not modify them significantly. 

In practice, we are faced with very different kinds of 
data, requiring a diversity of approaches, as we now describe. 



3.1.1 Kite tn AWM4 

Most of the galaxies in AWM4 have a measured velocity 
dispersion from SDSS spectra. For these galaxies we first 
correct the measured value for the standard aperture corre- 
sp onding to the effective r adius r e /8, using the recipe given 
bv |j0rgensen et all J 1995th Then we apply the scaling rela- 
tion of lPizzella et al. I (|2005l ) tO infer Vcirc. 

In cases where the velocity dispersion is not available, 
the relatively small distance to this cluster allows a reliable 
estimate of the structural parameters of the galaxies to be 
achieved. Hence we proceed as follows. 

(i) First we select early-type galaxies based on the con- 
centration index d = iigo p c tro j/Rso Petro.i > 2.5 as given 
by the SDSS in i-band (as in IBernardi et all [2003a! '). For 
th ese galaxies go is deri ved from the r-band FP relation 
of IBernardi et a l. (2003c), after applying k and cosmolog- 
ical dimming [(z + l) 4 ] corrections to the effective surface 
brightness. Thereaft er ao is converted into Vcirc using the 
iPizzella et all (|2005h relation as detailed above. 

(ii) Bright galaxies (rest-frame Mi < — 19 mag) with d ^ 
2.5 are considered bona fide disc-dominated galaxies and 
their V c i rc is computed via the TF relation. In order to min- 
imise systematic errors, our best estimate of Voi r e is gi ven by 
the mean of the TF estimate of IPizagno et al.| ([ 2007. using 
i-band Petrosian magnitudes) and of Tullv et al. ( 19981 . us- 



ing i-band 'total' composite model magnitudes converted to 
7c). In both cases magnitudes are fc-corrected and corrected 
for the i nclination-depende nt internal extinction using the 
recipe of lTullv et alj (|l998T ). i and Ic bands are explicitly 
chosen to mini mise the amount and uncertainty of this cor- 
rection (cf. e.g. |Pierinilll999l ; iPierini et al.l l2003). 
(iii) Finally, for galaxies fainter than Mi = — 19 mag and 
with d ^ 2.5, the concentration index is not indicative of 
the dynamical state (e.g. dwarf elliptical galaxies can be 
"hot" systems yet have low concentration). In this case our 
best guess Vcirc is given by the mean of the estimate from 
the FP - as in case (i) - and from the TF - as in case (ii). 

Statistical errors are computed by summing uncertain- 
ties on the measured quantities propagated to Vcirc and the 
typical r.m.s. scatter around the scaling relations, in quadra- 
ture. In par ticular, we ad o pt a scatter of 15 km s _1 for 
Vcirc in the IPizzella et"aT1 (|2005l 'l relation, 10% r.m.s. for 
gp from the FP, and 15% for Vcirc about the TF relation 
l|Pizagno et alj [20071 ) . The effect of random errors on the 
CSDF are quantified by means of Monte Carlo simulations 
(see Sect. l4~2"Tl . 

Systematic errors may have even greater impact on 
our conclusions about the CSDFs as they can shift or ex- 
pand/shrink the real distributions. We consider systematic 
unc ertainties for a l l ado pted scaling relations. In the FP 
and IPizzella et alj i|2005h relation we use the uncertainties 
on the fitting par ameters given i n the reference papers. In 
particular, for the IPizzella et all l|2005l ) relation we account 
for the covariance between the two fitted coefficients by re- 
writing the fitting function referred to the mean abscissa of 
the points and considering only the error on the slope. The 
covariance terms between t he FP parameters c an then be 
safely neglected as Fig. 2 of IZibetti et alj (|2002T l illustrates. 
For the TF estimates we adopt half of the range spanned by 
the tw o relations of IPizagno et alj (|2007T l and iTullv et al.1 
( 1998) as a systematic uncertainty. 

The set of all possible systematics and their permuta- 
tions gives us useful upper and lower limits for the computed 
CSDFs, as we will show in Fig. [31 



3.1.2 Kirc for RX groups /clusters 

For the five RX systems we rely on photometric data alone 
to compute Vcirc for the reasons outlined in Sect. [2] In addi- 
tion, their higher redshift relative to AWM 4 makes the use 
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of structural parameters much more uncertain. Moreover, 
uncertainties on membership determined through statistical 
methods (see Sect. I3.2|l will completely dominate over the 
uncertainties brought in by the scaling relations. Therefore 
we simplify the procedure described above. 

For the RX sys tems we determine K irc (i) either using 
the TF relation of iPizagno et al.l (|2007l ) for the most ac- 
curate r band or (ii) by converting oo, in ferred from the 
r-band magnitude via the FJ relation of Bernardi et al.l 
(2003b), into Vcirc using the Piz zella et al.l 



2005:) relation. 



The choice between the two is dictated by the colour of the 
galaxy, according t o the well known colour bimodality (e.g. 
iBaldrv et al.l 12004 ). For each cluster/group we look at the 
g — i colour distribution of galaxies with a photometric red- 
shift close to the redshift of the system, and determine by 
eye the cut between blue and red galaxies. The values of V c irc 
of the former are determined via the TF rela tion, while for 
the la tter we use the combination of FJ and IPizzella et al.l 
(120051 1 relations. 

All magnitudes we use for the scaling relations are taken 
from SDSS-DR6 and are corrected for foregro und Galactic 
extin ction, redshift (fc-corrections as given bv lCsabai et al.l 
2003) and, for red galaxies only, passi ve stellar evolution, 
accord ing to the output of the code of iBruzual fc Chariot! 
(2003). We have checked that our results are largely insen- 
sitive to the particular choice of colour cut or, alternatively, 
to a cut in spectral ty pe, as derived from the photometric 
redshift algorithm (see Csabai et al. 2 0031 . for details). 



3.2 Membership and statistical 

foreground/background subtraction methods 

With the exception of AWM4, for which cluster member- 
ship is assigned to individual galaxies via spectroscopic red- 
shifts (see Sect. IA1[) . member galaxy counts are based on 
photo metric redshifts from the SDSS-DR6 (Csab aTet al.l 
l200St ) and are obtained after application of statistical fore- 
ground/background subtraction methods. 

For each system, we define a circle corresponding to the 
projected -R200, centered at the coordinates of the peak of the 
X-ray emission, and 1 000 control fields of the same circular 
aperture, randomly distributed inside an annulus with inner 
radius 2i?200 and outer radius 4 degrees. The inner radius 
is chosen to avoid the cluster region, while the outer radius 
allows us to avoid control field overlapping. We assume each 
galaxy lies at the redshift of the system in question, and the 
corresponding property X (e.g. absolute magnitude, velocity 
etc.) is computed. Galaxy number distributions for the prop- 
erty X are computed in the cluster region (Do(X )) and in 
the control fields (Di(X)\r i=1 ^ 1000 \). The "true" distribution 
for the cluster is then given by D c i ust ci(X) = Dq(X)— D(X ), 
where D(X) is the median value of Di(X) over i for any 
given value of The confidence range for -Dciustcr(A) is 



5 The distribution computed in this way actually measures the 
excess of counts in the cluster vs. the field. To obtain the true 
cluster counts, we correct the field counts by subtracting the con- 
tribution of the physical space that would be occupied by the 
cluster. Such a correction is well below the per cent level in all 
cases. 



given by the distributions obtained by replacing the median 
value of Di(X) with the 16th and 84th percentile values. 

Although in principle this method does not require any 
pre-selection of galaxies, the background contamination is 
exceedingly high with respect to the net signal contributed 
by the cluster, so that a careful pre-selection is mandatory. 
To this end we use photometric redshift estimates and shape 
classifications provided by the SDSS for every source. Con- 
sidering the distances to our systems and the limiting mag- 
nitude of 20.5 r-mag (Petrosian, corrected for foreground 
Galactic extinction), all cluster/group galaxies should be 
safely resolved even in the worst case of a PSF FWHM equal 
to 1.5". Therefore we initially select only sources classified 
as extended ("GALAXIES"). 

We then apply a cut in photometric redshift to exclude 
the largest possible number of contaminants in the fore- 
and background, but avoiding exclusion of system mem- 
bers. Unfortunately photometric redshifts are typically af- 
fected by significant uncerta inties, from 0.03 r .m.s. at 16 
r-mag to 0.08 at 20.5 r-mag (|Csabai et al.ll200St ). Therefore 
the selected ranges z sys ± Az need to be quite broad. We 
optimise the result by adapting the cut widths Az to lin- 
early scale as a function of apparent magnitude, such that 
Az(m r = 14.5) = 0.05 and Az(m r = 20.5) = 0.1. 

This pre-selection in photometric redshift and stellar- 
ity index allows us to attain a satisfactory signal-to-noise 
(S/N), while leaving us with a clean and unbiased selec- 
tion. This is confirmed by the stability of our distributions 
when we adopt less restrictive cuts (at the cost of a degra- 
dation in S/N however). Moreover, as already mentioned in 
Sec. 12.21 the memberships of the brightest galaxies based 
on this photometric method coincide with those resulting 
from spectroscopic redshifts, whenever these are available. 
As a key test for our method, we next discuss the luminosity 
functions for all of our systems. 



4 RESULTS 

4.1 The luminosity function of fossil systems 

Figure[T]shows the luminosity function (LF) of the six galaxy 
systems. The objects are plotted from left to right and 
from top to bottom in order of ascending circular velocity 
^parent- We examine the LF in two apertures, namely within 
R200 (blue filled histograms and magenta lines) and O.5-R200 
(black hatched histograms and black lines). For all systems 
but AWM 4 error bars show the confidence intervals derived 
from control field statistics. 

The solid curv es represent the universal LF of 
iPooesso et ail (|2005l ). normalised to the total number of 
galaxies down to 20 r-mag (apparent). We stress that no 
other parameter is tuned in order to improve the match be- 
tween these curves and the measured histogram. Errors are 
too large to claim any agreement or disagreement with the 
universal LF for the least massive groups, because of the 
small number statistics and the weak contrast against the 
background. For the three most massive systems, however, 




Figure 1. The luminosity function of the six galaxy systems, ordered by ascending circular velocity from left to right and top to bottom. 
Counts are per bin of magnitude (0.5 mag width). Filled blue histograms and magenta symbols represent the entire area within -R20O1 
hatched histograms and black symbols represent the area within 0.5i?200- Error bars are derived via statistical methods (see text for 
details). The curves represent the analytical LF of Popesso et al. (2005a), normalised to the total number of galaxies down to 20 r-mag 
(apparent), with no other adjustable parameter. 



the plots show an almost perfect agreement within the error 
barfl 

The normalization N of the scales, as expected, 
with cluster mass or, equivalently, with X-ray temperature, 



6 Note that the brightest galaxy is not considered as part of the 
regular luminosity function. 

7 N is the number of galaxies per 0.5 mag at M r = —18.0. 



as we show in Fig. [2] The orthogonal fit to the data points 
(solid line) gives N oc L^ 79±0 ' 33 , where the error on the 
exponent is formally derived under the hypothesis of gaus- 
sian errors. If the assumption is made that the total optical 
luminosity of the cluster (r-band), L op t,r, scales proportion- 
ally to N, we can c ompare this result with the finding of 
IPopesso et~al1 (|2004h : L op t,r oc L^ 1 (dashed line in Fig. [2]). 
Formally our relation is significantly (at more tha n 2 sig - 
mas) steeper than the one found by I Popesso et all (|2004 ). 
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kT x /keV 

Figure 2. The "galaxy richness" of the systems N versus the 
X-ray temperature. The solid line is the orthogonal least squares 
fit to the points, assuming poisson errors on the number counts. 
The slope is reported in the panels. The dashed line shows the 
slope of 1.1 for the analogous relation observed by Popesso et al. 
(2004). 

but consistent with the 3/2 slope expected for self-similar 
systems. However, our small number statistics and possible 
systematics hidden behind the assumption L D pt,r oc N pre- 
vent us from drawing any quantitative conclusion. 

The LFs within 0.57?2oo also confirm the magnitude 
gaps typical of fossil systems (see Appendix [X]). This is par- 
ticularly remarkable as it shows that the photometric red- 
shift pre-selection works very well in the bright regime, and 
provides very high completeness and low contamination. 

Finally we note that the LF (inside 0.5i?20o) for 
RXJ1416.4+2315 and RX J1552. 2+2013 are in very 
good quantitat i ve ag ree ment with those determined b y 
ICypriano et~ai1 l|2006n and lMendes de Oliveira et all l|2006h . 
respectively, based on spectroscopic membership determi- 
nation. A detailed comparison indicates that the drop of 
number counts that we observe in RX J1552. 2+2013 at 
M r > —19 mag is fully co n sisten t with the observations 
of iMendes de Oliveira etail (2006), and therefore is most 
likely real. 

In light of the above we conclude that our statistical 
method of membership estimation is sufficiently robust and 
accurate to study the LF, and hence is applicable also to 
study of the CSDF. 

4.2 Substructure Distribution Functions 

Cumulative substructure distribution functions are con- 
structed following different methods for AWM 4 and the five 
RX systems. In the case of AWM 4 all spectroscopic mem- 
bers are used directly to build the CSDF from their esti- 
mated Kirc/Vparcnt- In the case of RX systems, the method 



described in Sect. 13.21 is adopted with the property X re- 
placed by Vrirc/Vparent- The CSDFs obtained in this way, 
assuming the values of Vparent given in Table f2J are shown 
as thick blue lines in Fig. [3] 

The limiting magnitudes that define the completeness 
of our sample translate into a very complicated complete- 
ness function for Vcirc/V P arent because of the different scal- 
ing relations adopted. By inverting each scaling relation we 
calculate the set of V c i rc corresponding to the limiting mag- 
nitudes of our samples. The maximum among these values 
is then our completeness limit for the CSDF. The CSDFs of 
the RX systems are cut at this limit in Fig. [3] For AWM 4 
the entire CSDF is shown, and the completeness limit is 
marked with a vertical dashed line. 

Figure [3] also shows statistical and systematic uncer- 
tainties. Concerning AWM 4, the V c irc of each galaxy has an 
associated error. To quantify the effect of these uncertainties 
on the CSDF we run 10 000 Monte Carlo simulations offset- 
ting each Vcirc by a random Av drawn from a Gaussian dis- 
tribution with the same width as the associated uncertainty. 
For each realization the CSDF is computed. The confidence 
range is determined from the 16th-84th percentile range of 
Vcirc/ Vparent at each step of the CSDF, and is shown as the 
cyan shaded area in Fig. [3] This randomisation procedure 
is undertaken assuming the standard scaling relations. If we 
now let the parameters of the scaling relations vary within 
their uncertainties, we obtain the orange and the magenta 
hatched regions as extreme cases. On the other hand, the X- 
ray data appear to be good enough to determine -R200 and 
Vparent with an accuracy of better than 10 per cent. This im- 
plies that galaxy counts would change only slightly, and the 
CSDF could shift horizontally by 10 per cent at most, which 
is comparable to or less than the effect of other systematic 
uncertainties. 

For the five RX systems, we consider only uncertainties 
due to statistical foreground/background subtraction and 
to the determination of the properties of the parent system. 
The cyan shaded areas in Fig. [3] show the 16th-84th per- 
centile range of variation due to the statistical uncertainties 
of background counts. The red thick lines represent the CS- 
DFs that we obtain by adopting the X-ray scaling relations 
determined from systems with kT > 3.5 keV instead of the 
full range (i.e., the parent system parameters derived from 
the 'hot' scaling relations, see Sect. [2}. The range of varia- 
tion due to each uncertainty is of the same magnitude at the 
lower end of the mass range; at higher masses, uncertainties 
due to statistical foreground/background subtraction domi- 
nate. 

We note that the observed M — Tx relations exhibit 
normalizations which are lower than those produced from 
simulations by a factor of ~ 10 per cent, perhaps due to a ne- 
glect of non-thermal pressure support l|Arnaud et al. I l2005l ; 
IVikhlinin et~all |2006l : iNagai et alTl2007l ) . Such a systematic 
effect would lead us to underestimate both -R200 and Vparent 
in the calculation of the CSDFs. This would tend to shift 
all CSDFs slightly down and to the right in Fig. [3] On the 
other hand, if fos sil groups had lower mas ses for a given 
T x as claimed bv iKhosroshahi et all (|2007t ). their CSDFs 
would shift to the right, in the sense of more abundant sub- 
structure. This should mainly affect groups with kTx < 2 
keV, i.e. only RX J1331. 5+1108 and RXJ1340. 5+4017 in 
our sample. It is worth noting, however, that these two 
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Figure 3. The cumulative substructure distribution functions of the six galaxy systems, ordered by ascending circular velocity from left 
to right and top to bottom. The blue lines are our fiducial CSDF determinations. Cyan areas display statistical uncertainties. Red lines 
and hatched areas (for AWM4) show the effect of systematic uncertainties, as described in the text. 



groups are those t hat lie closer to the M — T relation of 
normal groups fsee iKhosroshahi et al.ll2007l , their Figure 8). 
By comparing Rs and M s at overdensity 8 — 500 as given by 
IKhosroshahi et al l (120071) and as estimated from our fiducial 
scaling relations (|Arnaud et al.ll2005h . we conclude that the 
CSDFs of RXJ1331. 5+1108 and RXJ1340. 5+4017 could 
further shift to higher 14i rc /Vparent by 25 and 17 per cent 
respectively. Errors in the X-ray temperature itself propa- 
gate quite weakly on the CSDF. The effect of under(over)- 
estimating Tx is to under(over)-estimate both R200 and 



V^arent , with the result of decreasing (increasing) the galaxy 
counts but simultaneously shifting the distribution to the 
right (left). 



5 DISCUSSION 

Figure [3] shows an interesting feature: the CSDFs shift to 
lower Kirc/V'parent by almost a factor of two as the mass of 
the system increases. Noticeably this is in agreement with 
the statistical behaviour of 14irc,2nd/Vparcnt for the second 
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brightest member of S PSS groups/clusters as a fun c tion o f 
mass as presented by lYang. Mo. fc van den Boschl (2008). 
From their Figures 6 and 7 we compute that Vri r c,2nd/Vparent 
decreases by « 0.24 dex when M200 increases from 2 x 10 13 to 
3x 10 14 M s , as in our sample. This decrease nicely matches 
the shift observed in Fig.0and does not point to any anoma- 
lous behaviour of fossil with respect to non-fossil systems of 
the same mass. 

As a test, following ISales et~aL (2007) we compute 
the magnitude gap between the first and the tenth ranked 
member AM10 of AWM4, using the spectroscopic mem- 
bership determinations. With a central galaxy luminosity 
L = 2.34 x 10 n L Q and AM10 = 3.29 mag, AWM4 falls 
in the regio n covered by the simulations of isolated bright 
galaxies by Sa les et al. I l|2007l . their Figure 3). Once more, 
this suggests that fossil systems are not anomalous when 
compared to current ACDM simulations. 

To better prove this, we compare the CDFs of the 
five bona fide fossil systems with those of observed nearby 
clusters/groups and of simulated systems in the ACDM 
fr amework. In partic ular we refer to the results presented 
in iDesai et al. I (|2004 their Figure 5). These authors have 
measured CSDFs for 34 clusters/groups identified in the 
SDSS, wi th velocity d i spersi ons ranging from 250 to 1000 
km s -1 . IDesai et al] l|2004h also consider 15 simulated 
groups/clusters in approximately the same velocity disper- 
sion range and measured the corresponding CSDFs. Figure 
[4] reproduces their observed (left panel) and simulated CS- 
DFs (right panel) as hatched areas, overlaid onto the CSDFs 
of our five fossil systems (grey-shaded areas, displaying the 
range of statistical uncertainties, equivalent to the cyan area 
in Fig. [3] the thick black lines are the CSDF of AWM4). 

The CSDFs of all fossil systems fall in the range of mea- 
sured CSDFs for SDSS clusters. In comparison to simula- 
tions the CSDFs of our fossil systems are generally in good 
agreement, although an excess of substructure is observed 
at high Kirc/Vparent- This discrepancy is seen also betwee n 
the real and the simulated clusters by IDesai et al] (|2004h . 
As these authors show (their Section 6.4), it most likely re- 
sults from not properly taking the effects of baryons into 
account in simulations. What is most interesting to note 
here, however, is that none of the fossil systems appears 
to be lacking significant amount of substructure, this result 
being robust against systematic effects induced by different 
choices of scaling relations. 

In particular, we are unable to reproduce the results 
of DL04 concerning RX 1340.6+4018: although with large 
uncertainties, the archetype fossil group does not show any 
evidence for missing substructure. We note that the entire 
CSDF of DL04 (their Fig. 1) is shifted to a factor of two 
lower velocities with respect to ours. This might result from 
a different choice of scaling relations, although (as we show 
for AWM4) choices within a reasonable range of param- 
eters cannot change the results by such a large amount. 
Moreover our photometric dataset allows us to apply scal- 
ing laws in a very accurate and galaxy-type specific way, 
as detailed in Sect. 13.1.21 In contrast to DL04 we also take 
advantage of a much better and more complete sample se- 
lection, based on complete photometric coverage over the 
entire virialised region of the group, and perform robust 
statistical foreground/background subtraction. Finally, we 
have thoroughly investigated all possible sources of uncer- 



tainty which could propagate into our determination of the 
CSDFs of these systems, finding them all to be relatively 
small. 

In conclusion, the present analysis rules out lack of sub- 
structure in fossil clusters (M200 > 10 14 Mg), where our 
two photometrically derived CSDFs are robust and consis- 
tent with the CSDF of AWM 4 based on spectroscopy. The 
same appears to hold for lower mass fossil systems, although 
with non-negligible uncertainties. Spectroscopic determina- 
tions of CSDFs for fossil groups (M200 w 10 13 - 10 14 M ) 
would greatly help to reach a firm conclusion in this mass 
range. 



6 CONCLUSIONS 

We have studied six galaxy groups and clusters suggested 
in the literature to be fossil systems, and having high qual- 
ity X-ray and SDSS spectroscopic or photometric informa- 
tion. Among them, we have established AWM 4 as fossil sys- 
tem. We confirm three other systems (RX J1331. 5+1108, 
RXJ1340.6+4018 and RX J1416. 4+2315) to be fossil. 
RX J1256. 0+2556 has characteristics very close to a genuine 
fossil system, although observational errors are still too large 
for a robust classification as fossil. Finally we demonstrate 
that RX J1552. 2+2013 does not match the magnitude gap 
requirement to qualify as a fossil. 

For each system we have computed the luminosity func- 
tions within 0.5 and 1 virial radius. Although with uncer- 
tainties, that are remarkably large for the least massive sys- 
tems, they are consistent with the universal lum inosity func- 
tion of clusters derived bv lPopesso et al] (|2004l ). 

We have derived detailed cumulative substructure dis- 
tribution functions (CSDFs) for the six galaxy groups and 
clusters. Our motivation was to produce CSDFs for sys- 
tems with a range of masses in the group and poor clus- 
ter regime, for comparison with the original CDSF de- 
riv ed for the archetype fo ssil system RX J1340. 6+4018 
by iD'Onghia fc Lake! l|2004 DL04). In fact, these authors 
claimed a lack of substructure for RX J1340. 6+4018, sug- 
gesting that the so-called 'sma ll-scale crisis' of Milky- Way- 
size haloes i|Klypin et al.i ri999) exists up to the scale of X- 
ray bright groups. In addition we wanted to compare the 
CSDFs of our fossil systems with res ults from normal g roups 
and clusters identified in the SDSS l|Desai et ai1l2004l), and 



—ft— 

in co smological simulations (|Desai et al. 2004 ; ISales et al] 
120071 ). 

Our conclusions are as follows: 

• The CSDF of AWM 4, base d on spectroscopic data, is 
completely consistent both with IDesai et al] l|2004l )'s data 
an d with simu l ations . AWM 4 also matches the simulations 
bv lSales et al] (|2007l ) of isolated bright galaxies in terms of 
central galaxy luminosity vs. magnitude gap between the 
first and the tenth ranked member. 

• The photometrically derived CSDFs of the other four 
bona fide fossil systems are all completely consistent with 
the CSDF e nvelope derived f rom observed normal groups 
and clusters (jDesai et al.ll2004l). W i th res pect to numerically 
simulated systems in Desai et al] l|2004l ) none of our fossil 



systems appears to lack any substructure. 

We therefore conclude that no evidence can be provided 
that the 'small-scale crisis' is occurring on the scale of fos- 
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Figure 4. The CSDFs of our five fossil systems (gray shaded areas, displaying the range of statistical uncertainties, same as cyan areas 
in Fig. 3) compared to CSDFs measured for 34 SDSS clusters of galaxies (hatched area, left panel) and simulated clusters (hatched area, 
right panel) from Desai et al. (2004). The CSDF of AWM4 is highlighted by the thick black line. 



sil systems. In other words, the presence of a large magni- 
tude gap between the first and second ranked members of 
a group/cluster does not imply anything special about its 
substructure, which can be fully accounted for by existing 
LCDM simulations. 

Interestingly, we also observe a systematic shift of 
the CSDFs toward lower V^h-c/Vparcnt at increasing V pa rent- 
This can be reproduced using the scaling relations of 
first and second brightest members vs. halo mass de- 
rived for a representative sample o f groups and clusters by 
lYang. Mo. fc van den Boschl (|2008h . Once more, this rein- 
forces the idea that fossil systems are not anomalous as far 
as scaling relations are concerned. 

Further deep, wide-field spectroscopic observations of 
fossil systems are required to confirm the results we have 
obtained in the present work. This is particularly necessary 
at the low end of the mass range. On the theoretical side, 
analyses which mimic observational approaches such as that 
described here would allow us to compare real data and sim- 
ulations on an equal footing. This paper is the first in a se- 
ries which will characterise many of these aspects of fossil 
groups. 
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APPENDIX A: NOTES ON INDIVIDUAL 
OBJECTS 



Al AWM 4 



AWM4 belongs to a special sub set of poor clusters, orig- 
inally selected in t he optical by Morgan. Kavser fc White] 
l| 19751 . MKW) and I Albert. White fc Morganl (|l977l . AWM) 
in a search for cD-like galaxies outside rich clusters, where 
these galaxies ha d traditionally been found . NGC6051, 



= 12.93 mag (|de Vaucouleurs et alj Il99lh , located at 
z = 0.031 755 ± 0.000033 JWegner et al J 119991 ), is the cD 



of AWM 4. iKoranvi fc Gelled l|2002l ) subsequently identified 
28 members brighter than R = 15.5 mag. Most are early- 
type galaxies, concentrated in the center and with a smooth 
Gaussian velocity distribution centered at the velocity of 
NGC6051. The velocity dispersion of the system is 440 km 



the catalogue of images of galaxy clusters detected by the 
Einst ein Imaging Proportional Counter (jjones fc Formanl 
1999). No substructure nor a departure from symmetry 
was found in this X-ray image of AWM 4 at a 24 arcsec- 
resolution. This has been confirmed by the latest X-ray ob- 
servations, with XMM- jVewfon and at a resolution of 6 arcsec 
lO'Sullivan et al1l2005l ) , where the X-ray emission is centred 
on NGC6051. Despite the presence of a powerful AGN (see 
iGastaldello et al]l2008l . for a thorough discussion), the re- 
laxed a ppearance of AWM 4 bot h in optical and X-rays mo- 
tivated [Gastaldello^etjjl] |2007T ) to include this system in 
their sample of 16 bright relaxed groups/clusters to which 
they applied a hydrostatic analysis to measure mass pro- 
files. We use the results of their best fitting NFW profile 
to characterise the DM halo of AWM 4. The resulting total 
mass, 1.6 x 10 14 Mq, and X-ray temperature, 2.5 keV, qualify 
AW M 4 as a poo r clust er. 

iLin fc Mohil (I2004T ) first pointed out that AWM 4 ap- 
pears to be a fossil system, since it is X-ray luminous and 
meets the magnitude-gap criterion in Ks bancjf]. Within a 
half of the projected virial radius from the X-ray center of 
AWM two spectroscopic members have the same Ks-band 
magnitude gap from NGC6051, of Am = 2.2 mag. How- 
ever, fossil groups were defined using R-band photometry 
jjones et al I 20031 ) . In the following we show that the gap is 
present in R band too. AWM 4 is covered by SDSS imaging 
and spectroscopy out to i ts virial radius. On ly 4 over 135 
spectroscopic targets (see IStrauss et al. 2002, for the spec- 
troscopic target selection in the SDSS) do not have a valid 
redshift measurement down to the limit of r = 17.77 mag 
(corrected for Galactic extinction), corresponding to the 
absolute magnitude M r = —17.91 mag at the redshift of 
AWM 4 for the average fc-correction. The spectroscopic com- 
pleteness reaches 100% at r = 17.25 mag; it decreases to 
90% between 17.25 and 17.77 mag. This allows us to per- 
form a complete cluster-member identification that is almost 
a factor 10 deeper in l uminosity than previously done by 
IKoranvi fc Gelled (|2002T ). Moreover, the superior photomet- 
ric quality of the SDSS images allows us to establish the 
status of AWM 4 as fossil system, by safely assuming that 
the gap in r band is the same as in R band. 

We identify as members all galaxies within the pro- 
jected virial radius with spectroscopic redshift that differs 
from the velocity of the system by less than 1000 km s _1 . 
We find a total of 42 members, 23 within half of the virial ra- 
dius (including NGC6051). As SDSS photometry is known 
to underestimate the luminosity of large galaxies (see, e.g., 
iBernardi et al.1 [20071 ) because of the problematic sky sub- 
traction inherent in the automatic pipeline, we perform our 
own photometric measurements on the original r-band SDSS 
"corrected frames" for all galaxie s within 0.5J?2 0, foll owing 
the same procedure described in iGavazzi et all (|200lD . The 
sky background is measured in empty areas, sufficiently far 
away from galaxies, after masking stars. Elliptical isophotes 
are fitted to the images of individual galaxies using the IRAF 
task ellipse, after carefully masking contaminating sources, 
in particular the bright star projected on top of NGC6051. 



8 Photometry in the J, H, and Ks bands, complete down to Ks = 
13.5, is available from the Two Micron All-Sky Survey extended 



AWM 4 first appeared as an extended X-ray source in source catalogue (2MASS, Ijarrett et al.ll200ol) . 
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The resulting 1-D azimuthally-averaged surface brightness 
profiles are fitted with analytical functions (exponential, de 
Vaucouleurs or combined). Finally, total magnitudes are de- 
rived by extrapolating the measured flux to infinity, accord- 
ing to the best fitting analytic model. As expected, the lu- 
minosities of the brightest galaxies are significantly underes- 
timated by the SDSS automatic pipeline. By comparing the 
so-called 'model' magnitudes from the SDSS-DR6 with our 
own measurements, we find that NGC 6051 is reported 0.67 
magnitude too faint, while other galaxies down to « 15 mag 
are systematically fainter by 0.1 to 0.2 magnitude. 

Magnitudes for the three brightest members of AWM 4 
are reported in Table |A"T1 All magnitudes are corrected for 
foreground Galactic extinction. Column 4 lists our extrapo- 
lated magnitudes, reported along with the statistical uncer- 
tainty due to photometric errors and fitting uncertainties, 
and upper and lower systematic shifts due to background 
uncertainties. Column 5 contains our magnitude determina- 
tions within the isophotal ellipse corresponding to 25 mag 
arcsec -2 . Column 6 and 7 are the Petrosian and model mag- 
nitudes from the SDSS, respectively. 

From our extrapolated magnitudes we conclude that 
AWM 4 fulfills the requirement of magnitude gap ^ 2 mag 
in r band (w R band), with a Amu = 2.23 + O.IIIq' 2 ,^ mag. 
Comparison with the other magnitude determinations and 
the systematic uncertainty due to the background level also 
demonstrate how critical the inclusion of the diffuse envelope 
of the cD is in establishing AWM 4 as a genuine fossil system. 

A2 RXJ1256. 0+2556 

RX J1256. 0+2556 is one of the fossil group s origi- 
nally included in the sample of IJones et al.l H003). 
These authors reported that the presence of the mag- 
nitude gap within 0.5i? v ir critically depends on the ex- 
act value of i? v ir- Although a bette r dete rmination is 
now available from iKhosroshahi et all l|2007l ). the uncer- 
tainty on the X-ray temperature of this system (2.63 ± 
1.13 keV) translates into a large uncertainty on R200 = 
1.03±gj|Mpc = 4.66ti^ arcmin. The galaxy [JML2007] 
J125557.90+255819 .6 (whose membership is confirmed by 
iJeltema et al. 2007) is only 1.2 mag fainter than the bright- 
est member and is located at 1.96' from the peak of the 
X-ray emission. All other potential members with distance 
^ 1.96' have a magnitude difference with respect to the cD 
in excess of 2 mag. The uncertainty on -R200 therefore does 
not allow us to establish whether the ^ 2 mag gap is present 

or not inside 0.5-R20Q. 

Although I Jeltema et alj (|2007I ) have conducted a spec- 
troscopic campaign on RX J1256. 0+2556, we can not rely 
on their data to study the CSDF of this system due to the 
relatively high incompleteness of their survey (45-90% at 
V = 20.5), and especially the limited span of their data (the 
inner 700 kpc, thus only 70% of i?2<x>)- On the other hand, 
SDSS-DR6 only provides sparse spectroscopic redshifts in 
this region. Therefore, for the following analysis we will rely 
on SDSS photometric data alone. 

A3 RXJ1331. 5+1108 

This group has the lowest temperature (0.81 keV) in our 
sample. From available SDSS spectroscopy and photome- 



try we find Ami2 = 1.93 mag (SDSS model magnitudes), 
with the second brightest member within 0.5i?2oo (SDSS 
J133141. 49+110644.6) being located at 3.07'= (0.493 ± 
0.013)i?2O0 from the X-ray peak. As for AWM 4, we per- 
form our own photometric analysis and find a gap Amu = 
2.17 mag instead. The disagreement with SDSS is possibly 
generated by sky oversubtraction for the brightest galaxy in 
the SDSS photometric pipeline. Thus we confirm this group 
as a genuine fossil. 

A4 RXJ1340. 6+4018 

This group is the fossil group archetype (|Ponman et al.l 
1 19941 ). The magnitude gap is unambiguous here: the sec- 
ond brightest extended object within 0.5J?200 is ~ 2.6 mag 
fainter than the cD. DL04 based their claim for a substruc- 
ture crisis in fossil groups scale on data from this object. 
Contrary to DL04, who approximated the circular velocity of 
this group with Vparcnt = \[& (p being th e ID projected ve - 
locity dispersion of the group reported bv l Jones et alJl200Ch . 
we use more accurate X-ray determinations, but obtain a 
very similar value, within 30 km s" 1 . 

A5 RXJ1416. 4+2515 

This system, with its M200 ~ 3 x 10 14 M©, is rather 
a poor cluster than a group . It has recently been stud- 
ied by ICypriano et all ([2006) , who obtained spectroscopic 
redshift and studied the luminosity function in the inner 
~ 3' (« 0.35-R20o)- They confirm a magnitude gap of 
Am i2 = 16.73 - 14.19 = 2.54 mag in i band (AB), which 
we can safely assume to be close enough to the gap in R 
band. Although the region within 0.5i?2oo is not completely 
covered by their survey, we check against SDSS imaging 
that no brighter member is missed. It is worth noting, once 
again, that the SDSS magnitude for the cD is severely under- 
estimated by 0.54 i-mag and therefore would not have al- 
lowed a reliable estimation of the magnitude gap to be ob- 
tained. 

The limited cove rage provided by the observations in 
ICypriano et al.l (|2006l ) forces us to rely on SDSS photometry 
to compute the CSDF. 

A6 RXJ1552. 2+2013 

Similarly to RX J1416. 4+2515, RX J1552. 2+2013 is a 
poor cluster and has been the target of a spectro- 
scopi c campaign aimed at determi ning membership and 
LF ijMendes de Qliveira et al] l2006h . As in the previous 
case, the coverage is limited to the i nner « 3' (~ 
0.4i?2oo)- iMendes de Qliveira et all <|2006) report a gap 
Ami2 w 2.2 mag in i band (AB; see their Fig. 2). How- 
ever, by inspecting a larger region using SDSS images, 
at 2.6' from the X-ray peak we find an elliptical galaxy 
(SDSS J155201. 61+201350.5) of 16.0 i-mag, that is only 1.2 
mag fainter than the brigh test cluster galaxy. This galaxy i s 
missing from the sample of lMendes de Qliveira et alj |2006), 
likely because is only partly included in their image (their 
Fig. 1). For this galaxy, SDSS gives a photometric redshift of 
0.15, hence fully consistent with the redshift of the cluster. 
Assuming that this redshift is correct and our determination 
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Table Al. Photometry of the three brightest member galaxies in AWM4 



Rank 
(1) 


RA 
(J2000.0) 
(2) 


Dec 
(J2000.0) 

(3) 


magoo 
(4) 


mag M 25 
(5) 


Petrosian 
(6) 


model 
(7) 


1 (cD, NGC6051) 
2 
3 


16:04:56.79 
16:05:17.61 
16:04:50.55 


+23:55:56.4 
+23:45:20.4 
+23:58:29.6 


11.92 ± O.IIIq 27 

14.15 ± 0.03lo;S2 

14.73 ± omt °o2 


12.46 
14.27 
14.77 


12.72 
14.44 
14.83 


12.60 
14.37 
14.70 



of i?200 is correct, even if only within the large uncertainties 
quoted in Table [2j this cluster does not qualify as fossil. 



